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An essential feature of the classical theory of hypergeometric functions is the interplay 
between various ways of representing such functions: by integrals, solutions of differential 
qq'. equations, or series. The theory of A-hypergeometric functions [12-17] unifies and gener- 
0^ I alizes a considerable part of the classical theory by putting into the forefront the concept 
of a torus action. From a purely algebraic point of view, considering the torus actions 
5-H I means that we are interested in how a polynomial breaks down into a sum of monomials. 
^ I Thus, an A-hypergeometric function is a function in the coefficients of an indeterminate 
^ I polynomial f{x) = J^lvea'^'^^'^ ^ ^ ^"^ ^ finite set of characters of the algebraic 
torus (C*)"^, i.e., of Laurent monomials. For example, a typical Euler integral [16] is the 



> 



function 

(0.1) J(/) = / f{xr°x'^\..X^-dXi...dXr 



> 



', In the same vein, the A-hypergeometric series (or F-series) [13-15] [17] are explicit power 
series in the coefficients a^. On the geometric side, the theory becomes allied with the 
. , algebro-geometric theory of toric varieties [10] [18], the integral (0.1) being a period of a 
g_) I hypersurface in such a variety. 

The purpose of this paper is to give a generalization of the theory of A-hypergeometric 
functions to the case when the torus is replaced by an arbitrary reductive group H. The 
set A is then a finite set of irreducible representations of H. The space of polynomials 
on a given set of monomials is replaced by the space Ma of functions on H obtained as 
j_j ■ linear combinations of matrix elements of representations from A. Thus a hypergeometric 
^ function is a function on the space Ma', for instance, the Euler integral is written, similarly 

to (0.1), by J{f) = f f{x)°'x'^dx where x'^ is a multivalued character of H. The related 
algebro-geometric theory is that of spherical varieties, i.e., of equivariant compactifications 
of reductive groups and their homogeneous spaces coming from Gelfand pairs [3-5] [7-8] 
[32]. In fact, one of the reasons for the author's thinking about this subject was to begin 
understanding mirror symmetry for hypersurfaces in spherical varieties and its relation to 
the Langlands duality for reductive groups. 

The space Ma, being naturally a product of matrix spaces, can be regarded as a 
partial compactification of another reductive group G = Yl^^diuj) where d{u),u G A is 
the dimension of the representation. So the analogs of hypergeometric series in this new 
situation are, again, series in matrix elements of irreducible representations of G. Their 
construction can be obtained by generalizing the idea implicit in [14], namely, expanding 
the delta-function along a subgroup H G G G Ma into a series in matrix elements of 
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representations of G and then taking the termwise Fourier transform. This leads to a very- 
general class of generalized power series. Among their coefficients one finds the Clebsch- 
Gordan coefficients and other classical quantities of representation theory. Given that in 
the toric case the combinatorics of the coefficients of hypergeometric series is at the basis 
of numerical predictions for the number of curves in mirror symmetry [1] [25-27] [46], we 
give in §6 an example where the coefficients involve the 3j-symbols for the group SU2- 

The paper is organized as follows. In section 1 we introduce notation for decomposing 
functions on a reductive group into matrix elements of irreducible representations, so as 
to emphasize the analogy with ordinary monomials and polynomials and make writing 
formulas easier. Section 2 studies the spherical varieties Xa,Ya associated with a given 
set A of irreducible representations. These are not the most general spherical varieties, 
being compactifications of reductive groups, of the kind studied by De Concini and Procesi 
[7-8]. The varieties Ya are in fact, reductive algebraic semigroups studied in [41] [49]. In 
Section 3 we discuss "power series" on a group, i.e., series in matrix elements of irreducible 
representations and their use in representing analytic functions and distributions. Sec- 
tion 4 studies the Fourier transform of matrix elements of irreducible representations of 
GL{n) and the corresponding analog of the gamma function. These questions have been 
investigated in [21-23]. Next, in Section 5 we introduce the ^-hypergeometric system and 
develop the analogs of all three approaches known for the toric case: differential systems, 
Euler integrals, hypergeometric series. Finally, Section 6 is devoted to some examples. 

I was recently informed by I.M. Gelfand that a part of the constructions and results 
of this paper has been found by M.I. Graev (unpublished). 

My understanding of the subject of hypergeometric functions owes very much to I.M. 
Gelfand and A.V. Zelevinsky, as it is I hope clear from the content of the paper. The 
work on this paper started during the Taniguchi Symposium "Integrable Systems and 
Algebraic Geometry" held in Kobe and Kyoto in July 1997. I am grateful to the Taniguchi 
Foundation and to the organizers of the symposium for making this meeting possible. 
I am also very much indebted to the referees of this paper for pointing out numeruous 
shortcomings and inaccuracies in the first version. Thanks are due to V. Ginzburg, B. 
Hall, B. Sturmfels and V. Retakh for bringing several relevant papers to my attention. 
This research was partly supported by an NSF grant and by an A. P. Sloan Fellowship. 
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§1. Monomials and polynomials on a group. 



In this section we recall some well known properties of reductive groups. 

(1.1) Monomials. Let G be a reductive algebraic group over C. By Irr(G) we denote 
the set of isomorphism classes of (finite-dimensional, algebraic) irreducible representations 
of G. For a G Irr(G) we choose a representation Vq, in the isomorphism class of a, and 
denote hj pa '■ G ^ Aut(Va) the G-action on Va- The value of pa on x E G will be simply 
denoted by x". We will denote by a~ the label of the dual representation: V^- — V*. We 
also set d{a) — dim(14,). 

Let C[G] be the ring of regular functions on G, and Mq, C C[G] be the subspace 
spanned by the matrix elements of x", i.e., the space of functions of the form 

(LLl) fix) = (C, a;«) = tr(C • x"), Ce End(K)* ^ End(F«). 

Here we identify End(Va) with its dual by means of the form tr(a6). The space Mq, will be 
called the space of monomials of type a on G. The group GxG acts on the left on C[G] by 
the formula {{gi-, g2)f){g) — f {9x^992), and it is well known that we have a decomposition 
into irreducible subspaces 

aelrr(G) 

In other words, this means that any / e C[G] can be uniquely written as a finite sum of 
monomials: 

(1.1.3) /(a;) = ^(G«,a;"), G« e End(K.). 

a 

(1.1.4) Proposition. A function / G C[G] is conjugacy invariant if and only if all the 
coefficients in its expansion (1.1.3) are scalar matrices: Co. = Ca ■ Id. 

The monomial corresponding to Idy^ is just the character of the representation, which 
will be denoted by 

(LL5) Sa{x) = (Id, x") = tr(x"). 



(1.1.6) Examples, (a) Let G = (C*)" be the algebraic torus of dimension n. Then Irr(G) 
consists of 1-dimensional representations forming a lattice Z^. For a = (cui, ...,Q!^) e Z" 
the corresponding monomial is just the usual Laurent monomial 

X — X\ ••••^n" ' X = (^X\, X^) G (C ) . 
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(b) Let G = GLn{C). In this CctSG^ ctS well known, irreducible representations of G 
are labelled by sequences a — (cti > ... > a^) with ct^ G Z. We will sometimes call such 
sequences Young diagrams. We will write a > if > 0. The case a = (1,0, ...,0) 
corresponds to the standard representation V = of GL^(C). For arbitrary a the 
representation space Va will be denoted S"(F), so that is the Schur functor. The 
dimension of this space is given by the formula 



(1.1.7) dim(S"(C")) = dn{a) := 



Ul<i<j<ni^i - + j - 



yi-l<i<j<nU 

The character Sa{x) is the Schur symmetric function of the eigenvalues of x. Note that 

(1.1.8) ^i^i+h-,^n+i)(^Y^ = 5^(ai,...,a„)(-y^ ^ det{V), a;(«i+i.-,an+i) = . det(a;). 

We set |a| = ^ a^. 

The entries of the matrix monomial are homogeneous functions in the matrix ele- 
ments of X of degree \a\. They are polynomials if and only if a > 0. The dual representation 
corresponds to a~ = {—an, —oti). 

(1.2) Multiplication of monomials. The problem of finding the product of two mono- 
mials 

(C„ x«) • {Cp, x^), C« e End(K,), e End(F^), 
is reduced to the problem of decomposing <8) into irreducibles. Namely, let us write: 

(1.2.1) Va<»VpC^ 0^a/3 ® Vj, = HomG(F^, Va (g) V/3), 

7 

SO that N^f^ is the multiplicity space. Then we have the tensor product of the coefficients 
Ca^Cpe End(T4) ® End(y^) = End(T4 ® Vg). 

Let 

p^Pafs: End( V« ® Vf3) = End (^0 iV^^ ® Ky) End(iV^^ ® V^) 

be the projection onto the diagonal blocks, and 

(1.2.3) pIp : End(Fa (g) F^) ^ End(iV2^) End(F^) 



be the 7th component of pa/s- The following is a well known general fact. 
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(1.2.4) Proposition. We have 

7 

where 

tri : End(7V2/3) ^ End(K^) ^ End(K^) 
is tie trace witi respect to the second argument. 

(1.3) Multiplication and differentiation of monomials on GL„. Consider the case 
G = GLn. Then 3C — 1 1 X 1 1 IS itself a monomial corresponding to a = (1) := (1,0, ...0), 
so V(i) = V. The decomposition oi V ^ Va is given by the Fieri formula (see, e.g., [11], 
Proposition 15.25): 

(1.3.1) V<»Va= Vf3, 

f3=a+ei 

where the sum is over /3 = {f3i > ... > f3n) such that /3 — a is equal to the standard basis 
vector Ci for some i. In particular, the decomposition is multiplicity- free, so each occurrence 
of the trace (1.2.4) is taken over a 1-dimensional space. Thus we can eliminate it from 
the explicit formulas, saying that we have canonical maps p^-^^ ^ : End(y) (8) End(V^) — > 
End(V/3), even though there is no canonical element in the 1-dimensional space of maps 

We can write therefore: 



(1.3.2) 




Let now d = Ht^^II. This is a matrix- valued vector field on G; more precisely, d G 

Ox I j 

Vect(G) (E) End(y*). If a is an n by n matrix, we denote by (a, d) the scalar differential 
operator '^ajid/dxij. The following fact is the generalization of the formula d{x")/dx = 
ax"^~^ for scalar monomials. 

(1.3.3) Proposition. For a e End(F*) and G Eiid{Voi) we have 




where 

(pfi)^^)* : End(y* Va) ^ End{Vp) 

is the transpose of 

pfi)^^ : End(F) End(F^) ^ End(K). 
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Proof: Let L be the vector space of translation invariant vector fields on Matn(C). It is 
an irreducible representation of G x G, isomorphic to V* ® V while Mq, ~ Vq, (8) V*. The 
LHS and the RHS of the proposed equality are G x G-equivariant maps 

f3=a—ei 

The source of l,r is the tensor product of two irreducible representations. The target is 
a direct sum of several distinct irreducibles. Further, in the decomposition of the source 
into irreducibles each irreducible enters with multiplicity < 1 by Pieri's formula. Thus we 
have the following fact. 

(1.3.4) Lemma. Suppose there is a vector v & L ^ Ma whose projection to each Mp- 
isotypic component from the target of l,r, is nonzero and such that l{v) — r{v). Then 
I = r on the entire L <^ Mq . 

Take now v = IdC^Id E L Mq,. We claim that l{v) = r{v). Indeed, this statement 
reduces to a computation involving only the characters s^- Consider Sq as a symmetric 
function of n variables and let D = ^d/dti. Our statement that l{v) = r{v) 

thus reduces to the identity 

(1.3.5) {Dsa){t)= Yl {o^i + n-i)sp{t). 

(3=a—ei 

This identity follows at once from the Weyl character formula [11] once we notice the 
denominator of that formula is annihilated by D and thus can be treated as a constant. 

Further, in the case when ai + n — i ^ for all i, the equality (1.3.5) shows also 
that the projection of v to any M/3-isotypic component we are interested in, is nonzero, 
so Proposition 1.3.3 is true for such an a. Let us now identify Mq with Moi^^s,...,an+s for 
any s G Z in the standard way. Then, we get two families of maps 

l{s),r{s) : L^Ma^ M^, seZ 

f3=a—ei 

which obviously depend on s in a polynomial way. By the above, /(s) = r{s) for all 
except possibly finitely many s. Therefore /(s) = r(s) for any s and thus I = r for any a. 
Proposition is proved. 
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§2. Some algebraic geometry related to monomials and polynomials. 



(2.1) The space Ma- The (in)homogeneity condition. We start with a reductive 
group H and a finite set A C Irr(i7) of irreducible representations. Let 

(2.1.1) M^ = 0M^ = n^( e End(K.) } C C[H] 

be the space of polynomials on monomials from A. So Ma is a finite-dimensional subspace 
in C[H] invariant with respect to both left and right i7-actions. The coefficients serve 
as matrix coordinates in Ma, identifying it with 0^^^ End{V^). Wc can thus identify Ma 
with Ma via the form Xlc^eA ^^('^t^^a;) ^^'^ view both Ma, Ma as partial compactifications 
of the group G = YluieA^-^i^^^)- '^^^^ interested in generic behavior of functions 
from Ma- Let 

(2.1.2) p^=^p^:H^l[ GL{V^) = G^M\- {0} 

be the direct sum of representations from A. We will assume that pA is injective so that 
we can regard as a subgroup of G. 

In the sequel we will impose one of the following conditions on pa{H) C G (or, 
equivalently, on A C Irr{H)). Clearly, one of these conditions is always satisfied. 

(2.1.3) Homogeneity condition. The image pa{H) contains the subgroup of scalars 

C* = {(A,..., A) e YlGL{V^), A e C*}. 

(2.1.4) Inhomogeneity condition. The intersection pa{H) n C* is finite. 

We shall say that the pair [H, A) is homogeneous, resp. inhomogeneous, if it satisfies 
(2.1.3), resp. (2.1.4). 

Given {H,A) satisfying (2.1.4), we can construct {H,A) satisfying (2.1.3) so that 
Ma = Ma- namely, let H be the image oi C* x H under the multiplication map 

(2.1.5) p:C* X H ^G = Y[GL{V^), (\x)^Xx- 

Then each V^, a; e ^, is an irreducible ^-module. Denoting a) its isomorphism class, we 
get a bijection 

A ^ A, uj t-^ u), = V^- 

(2.1.6) Examples, (a) Let H = GL„. A set ^ C h:r{GLn) satisfies the homogeneity 
condition if and only if for any u> = (uji > ... > a;^) e A the sum = ^o;, is the same. 

(b) let H = SLn. Then any set A C Irr(S'L^) satisfies the inhomogeneity condition. 

(2.2) The varieties Ya,Xa- We assume that A satisfies the homogeneity condition. 
Let Ya be the Zariski closure of Pa{H) in M^. This is a conic variety, and we denote 
by Xa = P{Ya) C P(M^) its projectivization. The following properties of Xa, Ya are 
obvious from the construction. 
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(2.2.1) Proposition, (a) Ya is invariant under the H x H-action in and contains 
Pa{H) as an open orbit. 

(b) Xa is projective, invariant under the action of P{H) x P{H) and contains P{pa{H)) 
as an open orbit. 

(c) Functions from Ma are precisely the restrictions to pa{H) of hnear functions on Ya C 
M*A. 

(d) C[Ya], the algebra of regular functions on Ya, is the subalgebra of C[H] generated by 
Ma. 

Call a subset S C Irr(i/) monoidal if (the label for the trivial representation) is in 
S and for each a,P E S and each embedding Vy cVa^Vp we have 7 e 5. Let {A) be the 
minimal monoidal subset generated by A. 

(2.2.2) Proposition. The subalgebra C[Ya\ has the form 

C[^a]=0M«C Ma = C[H], Ma = Va<^V:. 

ae{A) aelrr(H) 

Proof: C[iy], as an H X ilf-module, splits into a direct sum of distinct irreducible represen- 
tations Mq, for all a e Itt{H). Thus CfYA], being an H x ilf-submodule, should have the 
form 0Q,£5 Ma where S C Irr(iy) is some subset. Since CfYA] is also an algebra generated 
by the M^,uj e A, we find that S = (A). 

(2.2.3) Corollary. The variety Ya has a natural structure of an algebraic semigroup 
containing the group H. 

(2.2.4) Proposition. The number of H x H-orbits on Ya is finite. 

Proof: This is a consequence of the fact that each irreducible representation of H x H 
enters C[Y'a] no more than once, see [44]. 

(2.2.5) Definition. If {H, A) does not satisfy the homogeneity condition, then we define 
Xa '■— Xa, Ya — Ya, where {H, A) is constructed in (2.1.5). 

(2.3) Tannakian point of view on Ya- We can generalize the construction of Ya as 
follows. Let S be any monoidal subset in Itt{H) generated by a finite subset. Then the 
subspace M[S] := 0q,gs is a finitely generated subalgebra in C[H]. The corresponding 
affinc algebraic variety will be denoted by Y[s] = SpecM[S']. Thus Ya is obtained when 

S={A). 

To the set S we associate the category TZ = TZs all regular representations V olH such 
that each irreducible component of V is isomorphic to some Va, ol E S . This is a monoidal 
category, i.e., if V, G TZ, then V ®W E TZ. Denote hy f : TZ ^ Vect the forgetful 
functor to the monoidal category of vector spaces (with the usual tensor product). Thus 
fiy) is V regarded as a vector space. The following fact is a version of the well known 
Tannaka-Krein theorem reconstructing a group from the category of its representations. 
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(2.3.1) Proposition, (a) Yj^] is an affine algebraic semigroup equipped with a semi- 
group homomorphism is : H ^ Y^s] with an open dense image. The map is is injective if 
and only if every representation Vq,, a G Irr(if) can he embedded into Vp(E)V^ for /3, 7 G 5". 

(b) The correspondence S ^ Y[s] establishes a bijection between finitely generated monoidal 
subsets S C Irr{H) and isomorphism classes of homomorphisms i : H ^ Y where Y is an 
affine semigroup and Im{H) is open dense. 

(c) Points ofYi^s] bijection with monoidal natural transformations a of functors from 
f to itself, i.e., with systems of endomorphisms ay '■ V ^ V given for all V e TZ and 
satisfying the following properties: 

(i) If (f) : V ^ W is a morphism of representations, then (jyay = ciw4^j 

(a) av(BW = (J'V © ClVigiW = (^v ® dw- 

The semigroup structure on Y^s] Is given by the composition of the operators: {ab)v = 
ay o by- 

The varieties Y^s] ^tre precisely the reductive algebraic semigroups studied in [41] [49]. 

(2.3.2) Example. Suppose that if is a torus. Then Irr{H) is the lattice of characters 
of a monoidal subset in it is just a sub-semigroup, M[S] = C[S] is the semigroup ring 
and Proposition 2.3.1 is the classification of affine toric varieties. 

(2.4) The Nevi^ton polytope and the orbit structure of Xa- The varieties Xa,Ya 
belong to the following general class of varieties with group action [3] [33]. 

(2.4.1) Definition, (a) Let K be a reductive group. An algebraic subgroup A G K is 

called spherical if some Borel subgroup in K has a dense orbit in K/ A. 

(b) An algebraic variety M with K -action is called spherical if it contains an open orbit 
isomorphic to K/ A, where A is a spherical subgroup. 

(c) For any afRne algebraic group G its rank rk(G) is defined as the dimension of any 
maximal torus. The rank of a spherical K-variety M is defined by rk(M) = rk{K) — rk( A) 
where A is as in (b). 

An equivalent formulation of the condition in (a) is that each irreducible representation 
of K occurs in the space C[K/A] not more than once. Pairs (K, A) with this property are 
known as Gelfand pairs. 

The example relevant for usis K = H xH, and A = {{x, x)} ~ H being the diagonal. 
Clearly, Ya is spherical with this choice of K, A. Similarly, Xa is spherical. 

Usually, one includes normality in the definition of spherical varieties. Since this is 
unnatural in our context, we will not do this and will take care in applying results which 
are stated in the literature for normal varieties. 

Choose a maximal torus T G H. Let A = Ch(T) be its character lattice (i.e., the 
lattice of weights of H) , and set Ar, = A ® R. Let also W be the Weyl group of H (with 
respect to T). We will identify Itt{H) with the set of dominant weights in A. 

Given a representation oj G Itt{H), we denote by Q^j C Ar the convex hull of all the 
weights of T on 14;. As well known, Q^^ = Conv{W ■ oj). For a finite subset A C Itt{H) as 
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before, we denote hy Q = Qa the convex hull of the union of the for oj e A. This is a 
VF- invariant convex polytope in Ar,. It will be called the Newton polytope of A. 

(2.4.2) Theorem, (a) H x H-orbits on Ya are in order-preserving bijection with W-orbits 
on faces of Qa (including the empty face). Denote by Y{T) the orbit corresponding to a 
face r. 

(b) Therefore the orbits on Xa are the projectivizations X(r) := P(Y(r)) for aU nonempty 
faces r C Qa (considered up to W -action). 

(c) Exphcitly, Y(r) is the orbit of the vector e(r) e J|^^^End(K;) whose components 
e(r)t^ : K, — > K, are defined as follows. Write the weight decomposition — ®xeK 
with respect to the T -action. Then eiT)^^ is the block-diagonal operator with respect to 
this decomposition whose diagonal block on is zero ifX^T and is the identity if A e F. 

(d) Each Y{T) is a spherical variety of rank equal to Tk{H) — codim(r). 

(e) In particular, minimal (closed) orbits correspond to W-orbits on the vertices of Qa- 
For such a vertex A the orbit X{\) is isomorphic to {H/P\) x {H/P\), where P\ <Z H is 
the parabolic subgroup whose relative Weyl group is the stabilizer Wx C W. 

(2.4.3) Examples, (a) Let H = GLn = GL{V) and let A consist of one element u = (1), 
so that Vcj = V is the tautological representation. Then Ya = Mat„(C). Orbits of H x H 
on Matn(C) are just sets of matrices with fixed rank. Thus there are n + 1 orbits. The 
polytope Qa is the (n — 1) -dimensional simplex, the convex hull of the n basis vectors in 
Ar, = R*^, and the Weyl group acts by permutations of the vertices. Thus there is only 
one orbit on faces of each dimension, and there are n + 1 orbits. 

(b) Let H he a semisimple group of adjoint type and let A = {oj} consist of one 
element which is strictly dominant. The variety Xa corresponding to the homogenized 
pair {H,A) from (2.1), is the minimal compactification of H constructed by De Concini 
and Procesi [7]. In this case Q is the "permutohedron" Conv{W -a;), with \W\ vertices 
forming one orbit. As shown in [7], Xa has in this case one closed orbit, isomorphic to 
(H/B) X (H/B), where -B is a Borel subgroup in H. 

(2.5) Proof of Theorem 2.4.2. The statement is covered by the existing general theory 
of spherical varieties [3] [8] [33] and especially that of reductive algebraic semigroups [41] 
[49]. Because of various notational differences, however, it seems the easiest to give a more 
self-contained proof, using the ideas of the cited papers. 

(2.5.1) Lemma. Let 

K = HxH, L^TxT, V = M^, ^; = (1, 1). 

u>eA 

Then any K -orbit inYA = K ■ v intersects the closure of L ■ v. 

Proof: (cf. [41], §3, Lemma 3.) Let H{{t)), resp. H[[t]] be the group of C((t)), resp. 
C[[t]]-points of H, and similarly for T. The Iwahori theorem (also known as the Cartan 
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decomposition) for reductive groups over local fields such as C((t)) gives 



(2.5.2) H{{t))^H[[t]]-T{{t))-H[[t]]. 

If X & Ya, we have x = limt_>o git)v for some meromorphic analytic curve g{t),0 < \t\ < e in 
H. Such a curve can be viewed as an element of H{{t)). Factoring now g{t) = fi{t)^{t)f2{t) 
with fi{t) e H[[t\] and ^{t) e T{{t)), we get, taking into account that v is the unit element 
of H, 

X = lim^(t)^ = \un{MtMt)Mt))v = /i(0) (^lim7(t)^)/2(0), 

which means that lim^^o l{t)v exists in Ya and that its H x i/-orbit contains x, proving 
the lemma. 

Let Ch(L) be the lattice of characters of L and ChR,(L) Ch(L) R. Let now 
V be any algebraic representation of the torus L and V = ^xeCh{L) ^® weight 
decomposition. For a vector v eV denote by vx e its component with respect to this 
decomposition. Set 

(2.5.3) Al{v) = {a : 7^ 0} C Ch(L), WtL{v) = Conv(Ai,(^;)) C ChR(L). 

Thus Wti(v) is a convex polytope known as the weight polytope of v, see [18] Ch.5, §1. For 
any nonzero vector w e F let P{w) e P{V) be the corresponding point of the projective 
space. The following fact is well known, see, e.g., loc. cit. Proposition 1.9: 

(2.5.4) Proposition. Let a : C ^ L be any rational map and let v' eV be any nonzero 

vector representing the point limT-^o -P(ci(t) • v) £ P{V). Then there is a face F C WtL{v) 
such thatv'x = for X ^ AL{v)r\T whilev'x is a nonzero multiple of vx ^ for X e AL{v)r\r. 

Setting now as before V = 0^^^ M^, we see that Al{v) is the set of all the weights 
in all the representations Kj, embedded diagonally into A® A = Ch(L). So WtL{v) = Qa- 
For any weight A G Al{v) the component vx is the identity map of the corresponding weight 
space. Thus Proposition 2.5.4 implies that any point in the closure of P{L ■ v) C Xa is in 
the L-orbit of the point described in Theorem 2.4.2 (c). Together with Lemma 2.5.1, this 
proves parts (a)-(c) of Theorem 2.4.2. 

Let us show (e). Let A be a vertex of Qa, by applying the Weyl group transformations, 
if necessary, we can assume that A is dominant. Since A is a vertex, the corresponding 
weight subspace of ©^^^^ is 1-dimensional, and thus the vector e(A) of operators has 
only one nonzero component, namely e(A)A '■ Vx ^ Vx- Further, this component is just 
the identity operator on the 1-dimension weight A subspace extended by along the other 
weight spaces. In other words, e(A)A = ® G ® V^T' where ^x is the highest vector 
in Vx and is the highest vector in V^. This implies (e). 

Finally, part (d) follows from Theorem 7.3 of [33] applied to the normalization of Ya 
once we translate the contravariant description of spherical varieties (via fans) used there 
into the dual covariant description (via polytopes) used here. 
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(2.6) Orbit structure of semigroups. For future reference we note a slight general- 
ization of Theorem 2.4.2. Let S C 1tt{H) be any finitely generated monoidal subset and 
Y^[S] = Spec(M[5']) be the corresponding affine semigroup from (2.3). The group H x H 
acts on Y[s] via the homomorphism is H ^ Y^s] a-^d has an open orbit whose stabilizer 
contains H. So Y^s] is an affine spherical variety. Let T, A be as in (2.4) and let Cs C Ar 
be the convex hull of all the T- weights of all the representations Va,a G S. This is a 
polyhedral cone. The Weyl group W naturally acts on Cs- The proof of the next theorem 
is similar to that of 2.4.2. 

(2.6.1) Theorem. H x H -orbits on Y[s] are in bijection with W -orbits on nonempty faces 
of the cone Cs- The orbit Y{T) corresponding to a face F is a spherical variety of rank 
equal to dim(F). 

We can also exhibit a distinguished point e(r) G ^(F). For this, we use the description 
of points of Y[s] from Proposition 2.3.1(c). Let TZ be the monoidal category of represen- 
tations corresponding to S- For every V E TZ we have the decomposition V = ® V^' 
where is the direct sum of all weight subspaces whose weights lie in F and V^' is the 
direct sum of all the other weight subspaces. To describe a point e(F) we will desribe the 
corresponding system of operators e(F)v :V^V,Ve7l- 

(2.6.2) Proposition. The collection of operators e{T)v = Idy^ © Ov^^' satisfies the condi- 
tions of Proposition 2.3-1 (c) and thus defines a point e(F) G Y[s]- The orbit Y{T) contains 
e(F). 

(2.7) The degree of Xa- In the notation of (2.4), let A^ = OP(T) be the lattice of 
1-parameter subgroups in T, i.e., the dual lattice to A. Denote by C A the root system 
of H and choose a system of positive roots R+ C R- Let also i?^ C A^ be the system 
of coroots [45] and be the system of positive coroots. Recall that R and R^ are in 
bijection; for a G i? let G i?^ be the corresponding coroot. Each is a linear function 
on the real space Ar,. 

(2.7.1) Theorem. The degree of the projective variety Xa C P(M^) is equal to 

where dX is the Lebesgue measure on Ar normalized so that Vo1(Ar/A) = 1, and the di 
are the characteristic exponents of H, i.e., the degrees of the polynomial generators of the 
algebra of W -invariant polynomials on Ar. 

This theorem was proved by B. Kazarnovski [31] in 1987. A more general result for 
arbitrary spherical varieties was proved by M. Brion [4] in 1989. Note that the function 
YYoL^R+i"^'^ 1 ^) is ^he famous Weyl volume element for the Langlands dual group G^, see 
[45]. The maximal torus T^ of is dual to T, so the quotient of T by its maximal 
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compact subgroup is canonically identified with Ar,. Thus the integral in (2.7.1) can be 
viewed as the volume of a conjugacy invariant domain in whose intersection with 
is the preimage of Qa under the map /T^ = Ar,. 

(2.8) The ^-discriminant. Let A C Irr(i?) be an arbitrary finite subset (satisfying or 
not the homogeneity condition). As in the toric case [18], we set 

and let Va C Ma be the Zariski closure of V^. We call Va the ^-discriminantal variety; 
in the case when it has codimenion 1, the equation of is called the ^-discriminant and 
denoted by A^. Thus is a polynomial function on Ma = 0^^^^ End(V^). 

(2.8.1) Proposition, (a) Va is conic and is invariant under both left and right actions 
ofH in Ma. 

(b) The projectivization of Va is projectively dual to Xa- 

Extending this construction, for any nonempty face F C Qa we denote by V^.r C Ma 
the conic variety whose projectivization is projectively dual to the orbit X{T) C Xa- This 
variety is irreducible, since X{T) is. It is clear that V^.r is also invariant under the left 
and right actions of H on Ma- In the case when VA,r is a hypersurface, we will denote 
by A^.r the irreducible equation of VA,r (defined up to a constant factor). 

In the case when H is a torus, the discriminants have been studied in [18] from the 
point of view of monomials entering into their expansion. In the present case it is natural 
to view the space Ma on which the Aa^f are defined, as a partial compactification of the 
group G = n GL{Vi_j) and expand the discriminants not in ordinary monomials but in the 
matrix elements of irreducible representations of G: 

(2.8.2) AA,r(EK'^"))= E (^"'^")- 

^ Q;eIrr(G) 

Here a = (0(0;))^^^^) thus a = {a{u!))i^^A with each a{u!) being an element of Irr(GL(V^)), 

i.e., a Young diagram. The coefficient Cq lies in End^(^^g^ S'*^'^)(V^)^ . The condition 

of left and right ilf-invariance of V^.r implies the following quasi-homogeneity property of 
its equation. 

(2.8.3) Corollary. Suppose that AA,r is dehned. There is a l-dimensional character 
X = Xr of H such that each coefRcient Ca of AA,r satisfies 



c«eEnd[[(g)s-(-)K,] ] 
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where the superscript x means the subspace of x-Quasiinvariants. 



3. Power series and distributions on a group. 



(3.0) Orthogonality relations. Let G be a reductive group, as in §1, and Gc d G 
a compact form. Denote by d*x the regular invariant volume form on G normalized 
so that d*x = 1. The orthogonality relations for the matrix elements of irreducible 
representations have the form: 

Here d{a) — dim(V'a) and Vq,- =V*. In particular, for the characters we have: 
(3.0.2) / So,{x)sp{x)d*x = 



fO ifa^/?-; 
1l iia = p-. 



(3.1) Power series and analytic functions. By a power series on G we mean a series 
of the form 

(3.1.1) /(x)= Yl (««'^")' a, eEnd(K.)- 

aelrr(G) 

We are interested in representing analytic functions on (some domains in) G in this way. 
Representing of functions on Gc in this way is the content of the Peter- Weyl theorem 
which, together with the orthogonality relations (3.0.1) gives the following. 

(3.1.2) Proposition. Let f{x) be an analytic function in some neighborhood of Gc in 
G. Then f can be written as the sum of an absolutely convergent series (3.1.1) with 

tta = d{a) / f{x)x^ d*x. 

(3.2) Example. The case of G'L„(C). For G = GL^ we take Gc — Un, the unitary 
group. In this well known [29] 

dx , TT , ^ f dx (27r)"("+i)/2 

(3.2.1) d*x = - ^ , , , dx=\\dxij, C= , , , = - — . 

^ ' Cdet{x)^' -L-L 7t^„det(a;)- H^'^ i\ 
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Also, if a = {ai, ...,an) is a Young diagram, then a = (— a^, — cki). So the formula 
for the coefficients becomes 

(3.2.2) aa = ^ [ /(x)x^-"-'^— -'-"-"i^dx. 

Recall that Un is the Shilov boundary of the domain 

(3.2.3) Dn = {x e Matn{C) : I - XX* > 0} . 

Here, as usual, the notation > means that the (Hermitian) matrix in question is positive 
definite. So we have the following fact. 

(3.2.4) Proposition. Let f be a function analytic on a neighborhood ofUn in GL„(C). 
If f can be continued to an analytic function in a connected domain in Matn(C) containing 
0, then f can be analytically continued to the entire and, in addition, the coefficients 
Qa in (3.2.2) are zero unless a >0. 

The reader can consult [35] for the general study of domains of convergence of power 
series on reductive groups. 

(3.3) Rings of formal series and convergence. Denote by C[[G]] the vector space of 
all formal power series of the form (3.1.1). This space is not a ring. However, we have the 
following fact. 

(3.3.1) Proposition. Let T>{G) be the ring of all regular differential operators on G. 
Then C[[G]] is naturally a 'D{G) -module, containing the space C[G] of regular functions. 

Proof: The structure of C[G]-module on C[[G]] follows from Proposition 1.2.4 describing 
the product of two monomials. If L is a left-invariant vector field on G, then L preserves 
each Mq, and so acts on C[[G]]. The ring T>{G) is generated by C[G] and invariant vector 
fields. The check that the relations holding in 'D{G) are satisfied, is standard. 

Let now S C Irr(G) be a finitely generated monoidal subset. Let also T C G be a 
maximal torus and A its character lattice, and Cs C Ar be the cone defined in (2.6). We 
shall say that S is strictly convex if Cs is a strictly convex cone, i.e., it does not contain 
linear subspaces and this G Ar is a vertex of Cs- Let Y^s] be the affine semigroup 
associated to S. Theorem 2.6.1 implies that Y[s] contains a unique G x G-fixed point 
which we also denote 0. 

Let M[[5']] be the completion of the ring M[S] = C[Y[s]\ at 0. This completion can 
be viewed as the ring of formal series 

(3.3.1) /(a;) = J](a«,a;-), a« G End(y«). 

Because of the strict convexity, the multiplication of two such series is now a well defined, 
purely algebraic operation accomplished via Proposition 1.2.4. Here is a useful sufficient 
condition for convergence of a series from M[[S']]. 
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(3.3.2) Theorem. Let f e be a formal series. Suppose that there is a holonomic 

system of Unear PDE on G with regular singularities (i.e., a holonomic regular T>{G)- 
modulc [2]) of which f is a solution. Then f converges to an analytic function defined on a 
neighborhood of in Y[s] • In particular, the domain of convergence of f in G is nonempty. 

Proof: For a smooth algebraic variety Z let T>z be the sheaf of rings of differential operators 
on Z. Let C be the sheaf of 'DG-niodules corresponding to the holonomic system in question. 
Let also G' C Yjg] be the open G x G-orbit, i.e., the set of all invertible elements of Yjg] 
as a semigroup. Then we have a surjective morphism of reductive groups a : G ^ G' . By 
Hironaka's theorem, there exists a resolution of singularities p : Y ^ Y^gj bijective over 
G' and such that p~^{0) is a divisor with normal crossings. Then p*f is a function on the 
formal neighborhood of p~^{0) in Y. In particular, for any y e p~^{0) we have the germ 
{p*f)y lying in OY,y — C[[j/i, j/„]], the completion of the local ring of Y at y. Let be 
the composition 

G^G"'-^ p-\G')-^Y. 

By the general theory, see [2], we have that 0*£ is a holonomic regular Py-module. It is 
also clear that each {p*f)y, y e p~^{0), is a formal solution of this module, i.e., 

iP*f)y e Hompy(0*£,C)r,y). 

Now, it is the main property of holonomic regular systems, see, e.g., [2], Prop. 14.8, that 
any formal solution is convergent. Thus each {p*f)y is convergent in some neighborhood 
of y. This means that there is a neighborhood U D P~^{0) in Y such that p*{f) converges 
to an analytic function in U. But U r\p~^{G') is identified with an open set in G', so we 
get that / converges to an analytic function on a nonempty open subset in G' (and hence 
to a function on a domain of G). Theorem is proved. 

(3.4) Distributions on a group. As with usual power series, series of the form (3.1.1) 
can be used to represent distributions on the group as well. We need the following examples 
which follow at once from the Peter- Weyl theorem. 

(3.4.1) Delta-function at 1. It follows from Proposition 3.1.2 that the series 
Si{x)= {d{a)- Id, x'')= dioi)tT{x'') 

aelrr(G) aGlrr(G) 

(sum over all the representations) represents the Dirac delta-function situated at the unity 
of G. This is an equality of distributions on Gc- 

Accordingly, the delta-function situated at any xq & G can be written as 
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(3.4.2) Delta-function along a subgroup. Let H (Z G he a. reductive subgroup. For 
any a e Irr(G) the space Va splits canonically into direct sum 



where is the space of ilf-invariants, and is the sum of the other isotypical compo- 
nents. Thus we have the embedding: 

End(V;^) C End(T4). 

Let Ia{H) be the image of the identity operator under this embedding. Then: 

5h{x)^ d{a)-{Ia{H),x'') 

a€lrr{G) 

is the delta-function along H. Again, this is an equality of distributions on Gc- Note that 

where He = Hr\GcCH is a compact form. This follows from the fact that the operator 
lyeH Pot{y)d*y is equal to the projection onto along V^. 



§4. The matrix gamma function. 



(4.1) Motivation. In the one-dimensional Fourier analysis it is well known that the 
Fourier transform of a monomial x", o: G C, is again a monomial x~^~°' but taken with 
the coefficient r(l + a), the Euler gamma function. For application to hypergeometric 
series we need a generalization of this to the case when a; is an n x n matrix and a is 
a Young diagram, i.e., we need to study the Fourier transform of the matrix elements of 
irreducible representations of GL^(C). This generalization was essentially done in [21-23], 
and we just formulate it in the form needed for applications. 

(4.1) Multivalued monomials. Throughout this section we set: 

y = C", G = GLn{C) = Aut(V), E = Mat„(C) = End(y). 

We denote g = glniC) the Lie algebra of G. Let also j : G ^ E he the embedding. We 
also set 

Irr = Irr(G') = {a = {ai > ... > a„) G Z"}. 
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For a e Irr we denote Vq; = S'^y the space of the corresponding representation. 

By means of the standard basis m.V = C"' we identify A"'^ ~ C. Accordingly, for 
any s G Z and /3 G Irr we identify V(^^+s^ ..^^^+s) with as a vector space, so that the 
G-action differs by 

P(/3i+s,...,/3„+s)(a;) = Pi3{x) ■ det(x)". 

Let now 

(4.1.1) 1= |cK = G C|Q;i-ai+i G Z+|. 
Every ck G I has the form 

(4.1.2) a = + (s, ...,s), sGC,/3Glrr. 

The set I serves to label multivalued holomorphic representations of G. Explicitly, if a G I 
has the form (4.1.2), we set Vq, = and define the G-action by Pa(2^) = P/3(a;) •det(a;)*. As 
usual, we write for Pa{x). This is a multivalued representation, but the corresponding 
representation of the Lie algebra g is well-defined and irreducible. 

Let A^Q, be the local system on G spanned by all the determinations (branches) of 
all the matrix elements of a;". More precisely, if a is as in (4.1.2), and Cg is the 1- 
dimensional local system spanned by all the branches of det(a;)'^, then Ada = -^/3 ® jCs, 
with Mj3 = End(T/g). Note that by construction Ala is a subsheaf in Og, the sheaf of 
holomorphic functions. 

(4.1.3) Proposition, (a) Ma is a G x G-equivariant local system on G. As such, it is 
irreducible. 

(b) We have an isomorphism of equivariant local systems Al* ~ A4(-a„,...,-ai)- 

(4.1.4) Corollary. There is a natural action of the Lie algebra g © g on each stalk of 
Ma and thus on any space T{U,Ma) where U is a connected and simply connected open 
set in G. This action is irreducible, of type V* <SiVa. 

(4.2) Fourier integrals over Hermitian matrices. Denote by Herm the subspace of 
Hermitian matrices in E. So Herm is an n^-dimensional totally real subspace in E. Let 
Herm_|_ be the cone of positive definite matrices in Herm, and let 7i G E be the Siegel 
upperhalf plane 

H = Herm + zHerm_|_ = {x : i{x* — x) > 0}. 

Let also V = —iTi. be the generalized right half-plane, so it is given by the condition 
X + X* > 0. The action of the group G x G on E does not preserve Herm, but the action 
of the real Lie subgroup A = {{g~^-, g*) & G x G} does. As a real Lie group, A ~ G but 
its embedding into G x G is not holomorphic. Let d be the (real) Lie algebra of A. Thus 
d is a real Lie subalgebra in the complex Lie algebra g ® g and d (g) C = g © g. 
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For a subset U C G we denote by M.a{U) the space of sections of Ada over U. Since 
Herm+ and V are, topologically, cells containing 1, we have identifications 

(4.2.1) Ma{r) ~ A^a(Herm+) ~ Ma,i- 

The power function t^,t E R+, z E C, will be always normalized by putting = e^'°s*^*^ 
with the standard choice of branch of logarithm on R_(_. We will understand the expression 
\x\^ (power of the determinant) for x e Herm_|_ accordingly. This defines an identification 
A4a,i — Mjs, where (3 is related to a as in (4.1.2). Similarly, we define an identification 

(4.2.2) Main) ~ A<«(Herm+) ~ Ma,i ^ Mp 

via the inclusion of Herm_|_ into the closure of Ti. 

Let q; e I be such that 5ft(Q;^) > 0. Define the linear operator (Fourier integral) 

(4.2.3) :A^,(Herm+)^0(H), (Fa/)(y) = / f{x)e''''^^y^dx, 

J Herm_|_ 

the integral being absolutely convergent. By identifying Ti with V via multiplication by i, 
we can write the same map in the form of a Laplace integral: 

(4.2.4) A, :M«(Herm+)^0(P), (A«/)(y) = [ f{x)e~'''^-yUx, 

./Herm_|_ 

Recall that the Lie algebra g © g acts on Ala (Herm_|_). We will also use the following 
twisted action of g ® g on 0{V): 

ill, 72) * / = n(tr(72) - tr(7i)) • / + (72, 71)/, 
where the last summand on the right is the standard action. 

(4.2.6) Proposition. The map Aq is g©g-equi variant, if we consider the standard action 
on AlQ,(Herm_|_) and the twisted action on 0(V). 

Proof: Since Aq, is C-linear, it is enough to prove d-equi variance. This follows via a linear 
change of variables on Herm+. 

(4.2.7) Theorem. The map Aq, defines an isomorphism of A^Q,(Herm+) with 
M 

—n—an,---,—n—ai 

{V) c 0{V). 

Proof: The space A(a(Herm_|_) being an irreducible g ©g-module, it is enough to find the 
effect of Aq, on a generator of it, for example on the function Sct{x) = tr(x"). This has 
been done in [23], Th. 5.9, which, after being translated to our notation, reads: 



{Ksa){y) = / e-'^^-yha{x)dx = 

^Herm_|_ 
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n 

n(n — l) 



(4.2.8) =7r^^ [[T{aj+n-j + l)s^ri-ar.,...,-n-aM- 

(See also [32], formula (12.6) for an evaluation of an equivalent integral.) So the generator 
is mapped into a nonzero scalar multiple of a generator and our statement follows. 

(4.3) The matrix gamma function. For a e I set 

n 

(4.3.1) rn{a) = l[r{aj + n-j) 

and call this meromorphic function on I the matrix gamma function. For s G C we will 
write Tnia + s) for Tn{ai + s, + s). The map Aq,, as it follows from (4.2.8) and 

equivariance, is essentially scalar: 

(4.3.2) A«[(a,a;")] = 7r''^r„(a + l)(a*, x"^-"— --"-'^O. 

Here a e End(yQ,) and a* e End(VQ^) is its transpose. We can also express this as follows: 

(4.3.3) Aa(x") = TT^'^Tnia + l)(a;-n-a„,...,-n-«i^t^ 

where we regard x°' as a F^(8)Vq,- valued function, while a;-"-anv,-n-ai ig ^ Va^V*-valued 
function. 

(4.4) Distributional version. Since the Fourier transform is involutive, a different 
setting will lead to the appearance of r„(Q; + 1)~^ and not of r„(Q; + 1) as a proportionality- 
factor in the Fourier transform of x"'. To overview both settings, it is convenient to work 
with distributions on Herm, directly generalizing [20], §11.2. 

First, define a End (Vq:) -valued distribution on Herm given by 



(4.4.1) x'^ 



x", if x e Herm+; 
otherwise. 



Second, since Herm is the Shilov boundary of the Siegel upperhalf plane H, any analytic 
function f mTi has a boundary value on Herm, which is a hyperfunction denoted by 

(4.4.2) f{x) = f{x + iO) ^ lim /(x + zr). 

TGHerm_j_ 
T—>0 

The identification MaiTi-) — M-a,! from (4.2.2), gives an End (Vq,)- valued analytic function 
x°' in H. Its boundary value {x + iO)°' on Herm is in fact a distribution. 

Now, the Fourier transform of distributions on Herm is induced by the transform of 
test functions given by 

(4.4.3) ^[0](y)= / (p{x)e'''^''y'^dx. 

J Herm 

20 



It is also denoted by F and satisfies 

(4.4.4) FF[f{x)] = {27rr"f{-x). 

Now, (4.3.3) implies, similarly to [20], the following equality of matrix- valued distributions 
on Herm: 

(4.4.5) F[x%] = e ^ ' TT^^Tn{a + l)(y* + iQ)i-n-ar.,...,-n-a^) ^ 

and therefore 



(4.4.6) F[{x + iO)"] = 2"^"^ 



. t 

y{—n—an,---,—n-ai) 



^n{-n - an + l, -n- ai + 1) 
(4.5) Divided powers. Let a el. We denote 
(4.5.1) x^ 



.((«)) - _ ^ 



a 



r,(a + l)' 

regarding this as a matrix-valued function in the right half-plane V. Here we use the 
normalization of x"' in V described in (4.2.1). The function x^^"^^^ will be called the 
divided power. 

It follows from Proposition 1.3.3 that the derivatives of x*-*^"-*-* have a particularly 
simple form. In the next proposition we conserve the notation of (1.3). 

(4.5.2) Proposition. For a e End(V^*), ba G End{Va) we have 

(a,a)-(6«,a;«")))= J] Upf,^^f,Y{a^b^),x^^''A. 

f3=a-ei ^ ^ 

(4.6) Example: exponential series. If a G Irr, a > is a positive Young diagram with 
\a\ = m, then let Wa be the corresponding representation of the symmetric group Sm- Let 
Wa = dim(Wa)- By the Weyl reciprocity theorem, 

(4.6.1) ^ w^^Va, 

\a\=m 

as a G-module, which implies that 

(4.6.2) tr(a;)^= ^ w^-s^{x). 
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For any Young diagram a = (cki > ... > am) with m cells the number Wq, is given by the 
well known formula (see [11], formula (4.11)): 

(4-6.3) Wa = f ^' ^ n ~ 

L_i (ai + 171 — 1)1 

Note that as long as a has no more than n non-zero parts (which is true for a entering 
into (4.6.2)), 

Ul<i<j<ni^i-^3+j-i) ^ ^l<^<J^<m(«^ -«i + J " ^) 

Therefore, using the formula (1.1.7) for d{a) we get: 

w^s^jx) _ d{a)sa{x) _ 'J^' 



\a\l "r^(« + i)' 

or, equivalently, 

tr(a;)™' ^ s^ix) 



(4.6.5) e^'^(-) = y = y rf(a) ^ , 

m=0 aGirr ^ 

Here we extended the sum over the entire set Irr, since 1/Tn{a + 1) = unless a > 0. The 
equality (4.6.4) can be seen as the termwise Fourier transform of the formula 

(4.6.6) 6i{x) = J2 d{(^>a{x), 

a€lrr 

discussed in (3.4.1). Note that (4.6.6) is an equality of distributions on the unitary group, 
so it is not possible to formally deduce (4.6.5) from it, if in the Fourier transform we 
integrate over the space of Hermitian matrices. 

(4.7) Contour Fourier transform of single-valued monomials. When considering 
single- valued functions on G = GL^, we can take the contour in the Fourier integrals to 
be the unitary group Un- Thus, we define the contour Fourier transform to be the map 

(4.7.1) FC:C[G]^C[G], FC[/](2/)=/ f{x)e"'^-yUx. 

Here the integral can be, of course, calculated purely algebraically, in terms of coefficients 
of the expansion of / into monomials. The analog of the formula (4.4.6) in this algebraic 
situation is as follows: 

(4.7.2) pQ^^(-n-a„,... -n-a„)| ^(-r. V"" 
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where C is the same as in (3.2.1). The formula (4.7.2) follows at once from (3.2.2) and 
from the series expansion (4.6.5) of e^'^^^\ 



§5. The A-hypergeometric system. 



(5.1) The system and its Fourier transform. We consider a pair of reductive groups 



satisfying the homogeneity property (2.1.3). We define the space = 0^^^End(K;) 
and varieties Ya C M^, Xa C P(M^) as in §2. Thus is i7-biinvariant and contains H 
as an open orbit. Let I a C S*{Ma) be the homogeneous ideal of Ya- 

Let h be the Lie algebra of H, and x : h — > C be a character. Let us identify S*{Ma) 
with the ring of differential operators on Ma with constant coefficients. More precisely, 
for / e S'{Ma) we denote by Pf the corresponding differential operator. 

By definition, the A-hypergeometric system corresponding to the character x, is the 
following system of linear differential equations on a function $ e 0{Ma)- 



Here Lh and Rh are the infinitesimal generators of the left and right iJ-actions on Ma- 
Thus the first group of equations just expresses the quasihomogeneity of Holomor- 
phic solutions of this system (defined over some open sets in Ma) will be called A- 
hypergeometric functions. We denote hy H = 'Ha,x the sheaf of such functions. 

For a finite-dimensional space V let 'D{V) denote the algebra of differential operators 
on V with polynomial coefficients. There is a natural isomorphism (j) : V{V) — > Viy*) 
called the (formal) Fourier transform. If a;i, xjv are linear coordinates in V and yi, yn 
are the dual coordinates in V*, then 



For P e T>{V) we wiU denote 0(P) simply by P. 

Now take V = Ma and apply the Fourier transform to the system (5.1.1). In this way 
we get the following system on a function on M^; 



HgG=Y[ GL{V^), a C Irr(iy), 



(5.1.1) 



Lh^ = Rh^ = x{h) • heh, 
Pf^ = 0, / e Ia. 




(5.1.2) 



Lft* = Rh^ = x{h) ■ heh 

/ • * = 0, felA. 
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Note that L^, resp. Rh is just the infinitesimal generator of the left, resp. right ff-action 
on dual to that on Ma- The second group of equations means that ^ is supported on 
Ya, so solutions exist only among distributions. 

(5.1.3) Theorem, (a) The system (5.1.1) is holonomic, with regular singularities. In 

particular, there is an open subset in Ma (/^generic stratum") such that the restric- 

tion of the sheaf Ti to M^^ is a locally constant sheaf on Ma of hnite rank. 

(b) More precisely, M^^ is obtained from Ma by deleting the varieties V^.r? see (2.8), 
for all proper faces F of the polytope Qa- 

(c) Supose that the variety Ya is Cohen-Macaulay. Then the rank of the sheaf H at any 
point of M^'^ is less or equal to the degree of Xa (which is given by the Kazarnovskii-Brion 
theorem 2.7.1). 

(5.1.4) Remark. In the toric case, the Cohen-Macaulay property implies that the generic 
rank of H is equal to deg(X^), see [15]. Without this property, the generic rank of H can 
be greater, as shown by B. Sturmfels and N. Takayama [47]. 

(5.2) The hypergeometric P-module. The proof of (5.1.3) is similar to that in [15] 
and is based on the analysis of the P-module corresponding to the system (see [2] [28] for 
general background on D- modules). If Z is a smooth algebraic variety, we denote by T>z 
the sheaf of regular differential operators on Z and hy T>{Z) the ring of its global sections. 
For a coherent P^-module Af we denote by SS{J\f) C T*Z its characteristic variety and 
by SS(A/') the characteristic cycle. 

We denote for short V = Vma ^^id V = Vm-^ Let M = M.a,x be the P-module 
corresponding to the system (5.1.1): 

(5.2.1) Ma,x = I) / ^ D • + 5^ P • (L, - x(/i)) + ^^^h - X{h)). 

' feu heh heh 

Thus the sheaf of ^-hypergeometric functions can be written as 

(5.2.2) nA,x = Hom^(MA,x, Om^)- 

Let also A4 be the D-module corresponding to the system (5.1.2). It is a particular 
case of P-modules described in the following theorem, see [2], Ch. VII, Th. 12.11 or [28], 
§5. 

(5.2.3) Theorem. Let K be an algebraic group over C acting on a smooth algebraic 
variety Z . Let W G Z be a closed subvariety which is the union of hnitely many K -orbits 
and let Iw C Oz be the sheaf of functions vanishing on W . Let k be the Lie algebra of 
K and /9 : k — > C be a character. Then the Vz -module 

Vz /vz-Xw + Yl ^^(^fe - /^(^)) 
' feek 
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is holonomic, with regular singularities. Its characteristic variety is contained in the union 
of the closures of the conormal bundles Tq{Z), where O runs over the K -orbits in W. 

The module M corresponds to K = HxH,Z = M^, W = Ya- The proof of Theorem 
5.1.3 (a-b) is now done in the same way as in [15]: the module M. being monodromic in the 
sense of [6], its Fourier transform, i.e., Al, is again holonomic regular by Corollary 7.25 of 
[6], which gives (a). To see (b), let ^ : T*Ma T*M\ be the natural identification of the 
contangent spaces. The result of [6] just cited implies also that SS{Ai) = {S S (M.)) 
which gives (b). 

We now prove part (c). We start with the following lemma. 

(5.2.4) Lemma. Let Y C C''^ be a conic (C* -invariant) closed algebraic variety, whose 
projectivization P{Y) C P^~^ has degree d, and let E C be a linear subspace such 
that dim{E) + dim(y) = N andY (IE = {0}. IfY is Cohen-Macaulay then 



dimc(^C[£;] ^C[x^,...,xr,] C[Y]^ = d. 



Proof: Let be the projective space containing C^, and E^Y be the closures of E,Y 
in P^, so that £■ is a projective subspace and deg(Y') = d. Then E r\Y = E (lY consist 
of one point, namely e C^. Therefore 

^(-l)MimcTorf t'^^'-'^"](C[E],C[r]) = 



as this is the contribution of the only intersection point of E and Y into their global 
intersection index on P^ , which is d = deg(Y"), see [43]. On the other hand, let Zi, ...,/m 
be independent linear equations of E. As dim(£' DY) = = dim(y) — m, we conclude 
that /i, ...Jm form a regular sequence in C[F], see [38], Th. 17.4. The Koszul complex 
associated with this sequence is precisely the complex calculating the Tor's above. Since 
its homology in degrees other than vanishes, we conclude that Tor^ = for i and 
the lemma follows. 

Let now h G h. The vector field Lh on Ma can be regarded as a family of linear 
functionals Lh{a) : M\ — > C depending on a G Ma- These functionals form the highest 
symbol of the equation Lh^ = x{h) ■ $ from (5.1.1). For given a e Ma let Xhia) C M^ be 
the kernel of Lh{a). Similarly, let Rh{o) : — > C be the linear functional corresponding 
to and Ph{o) be its kernel. Now, the following fact is clear from the definitions. 

(5.2.5) Lemma. Let a G Ma-, /i G h. A point b G lies in \h{a), resp. in ph{o,), if and 
only if the vector 

d_ 
It 



th 1 ^ 

e ■ b, resp. — 



b-e"" e Ma 

t=o 
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is orthogonal to a. 



Let 

A(a) = Pi Xh{a), p{a) = f] ph{a) 

be the zero loci over a of the highest symbols of the first two groups of equations in (5.1.1). 

(5.2.6) Corollary. A point b e lies in X{a), resp. p{a), resp. A(a) n p(a) if and only 
if the hyperplane Ker(a) C is tangent to the left H -orbit, resp. right H -orbit, resp. 
H X H -orbit ofb. 

In particular, for xq e H the point b = (a;o)u;eA of Pa{H) C M\ lies in A(a) or p{a) 
if and only if the polynomial fa{x) = '^{cIujj x'^) on H has a critical point at a; = a;o (the 
critical value is automatically by homogeneity). 

(5.2.7) Corollary. If a e Mf"", then A(a) n p{a) n = {0}. 

Now, noticing that codim A(a) = codim p(a) = dimYA, we can find a linear subspace 
E C M\ of codimension equal to dim(yA), containing A(a) n p(a) and such that Er\YA = 
{0}. Therefore, by Lemma 5.2.4, the quotient of C[Ya] by the ideal generated by the linear 
equations of has dimension equal to deg(X^). Thus the quotient by the ideal generated 
by the linear equations of A(a) f^p{a) has dimension less or equal to deg(X^). Finally, this 
latter quotient is just obtained by taking the highest symbols of the equations in (5.1.1), 
so the quotient by the full characteristic ideal has the rank less or equal to that. This 
proves part (c) of Theorem 5.1.3. 

(5.3) Fourier integrals. We keep the above assumptions on H,A,x- The system of 
differential equations 

(5.3.1) Lfi{u) — x{h) ■ u, hEh, 

together with the initial condition u{l) = 1, defines a multivalued "monomial" function 
on H which we will denote x'^ , a = (j{x)- Denote hj C — the 1-dimensional local 
system on H spanned by all the branches x'^ . Let C,{H, C) be the singular chain complex 
of H with coefficients in £, see, e.g., [16]. An element of Cm{H, jC) is thus a finite linear 
combination of pairs (7, 0) where 7 : A"^ — > i7 is a singular m-simplex and (/> is a section 
of 7*£ on A"*. The differential is defined by the usual rule. Let Ci^ {H^ C) be the bigger 
complex consisting of locally finite combinations as above. As well known, the homology 
of these complexes is expressed via sheaf cohomology (with or without compact support): 

H^{H, C) = H^{H, Cy, Hll{H, C) = H^{H, Cy . 

We regard H as embedded into M\. Let K C M\ be any strictly convex closed cone. 
Denote by Ci^\H,C) the subcomplex in Ci^{H,jC) formed by such locally finite chains 
which are contained in K except for finitely many simplices and which are semi-algebraic at 
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the infinity of D -ff in the sense of [40] . Let also ci^^ {H, C) be the bigger subcomplex 
consisting of such locally finite chains that all their simplices that do not belong to K, lie 
in a bounded subset of M\ (and which satisfy the same condition at the infinity of as 
before). We will denote the homology of these complexes by H^\Hj C) etc. 

Let N — dim(i?). We define the complexes of sheaves on Ma by their stalks: 

(5.3.2) 

Here means the imaginary part of a complex number. Define the morphism of sheaves 
(Fourier integral) 



tr(at^ 



dh. 



Here the sum (i.e., the improper integral) always converges because of the fast decay of 
the exponent in any cone K in (5.3.2). Note that in (5.3.3) we regarded H as a subvariety 
in given by the parametric equations = x^,x E H. Thus, regarding the linear 
function '^tT{au,bu,) as a polynomial f{x) = '^{au,,x^) on H, we can rewrite the map I 
as follows: 

(5.3.4) 2:(^(t., 0.)) {f) = J2 [ <t>^e'^^^^dx. 

(5.3.5) Proposition. The image under I of any section of T satisfies the A-hypergeometric 
system. 

Proof: Straightforward. 

(5.3.6) Remark. The above proposition is just a manifestation of the general principle 
that the Fourier transform of a solution of a linear differential system, whenever it makes 
sense, is a solution of the (formally) Fourier transformed system. More precisely, since 
H = Pa{H) is an open orbit in Y^, the space of solutions of (5.1.2) near the generic point 
of Ya is 1-dimensional and generated by the following "holomorphic distribution" : 

(5.3.7) (pA)*(a;") = Suih) ■ PA\h)\ b e G G M^. 

This is just the delta function along H C G multiplied by a power function. The sheaf 
is formed by all possible contours which can be used to define the Fourier transform of this 
delta function. A more suggestive and classical way to rewrite a function from the image 
of T is: 

(5.3.8) $(/)=/ a;V^(^)da;= / expfij^tvia^ ■ b^)]6H{b)p2\bydb. 
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Here C is an "appropriate contour of integration" (the exact meaning of this is provided 
by the sheaf J-\ For the toric case Fourier integral representations of hypergeometric 
functions were studied in [12-13] where the case of an arbitrary locally compact ground 
field k is considered. For /c = R (and H a torus) the framework of [12-13] gives the 
restrictions of A-hypergeometric functions to real values of variables while for A; = C it is 
slightly different from the one presented here in that we allow more complicated domains 
of integration. 

(5.4) Euler integrals. Suppose now that we have a pair (i^O: ^o) satisfying the in- 
homogeneity condition (2.1.4) and let (-ff, A) be the group and the set of representations 
obtained in (2.1), so that they satisfy the homogeneity condition and the ^-hypergeometric 
system is defined. We have an exact sequence 

(5.4.1) 1 ^ i^o n C* ^ i^o X C* ^ if ^ 1, H ^G= Y[ GL{V^) 

with p being the multiplication map. Recall also that we have the identification Aq — > A, 
uj ^ u) with V(j — Vuj a,s a, vector space, and thus Maq — Ma- We want to represent the 
solutions of the ^-hypergeometric system (which are functions on Ma = Maq) as certain 
integrals of / e Maq over Hq. 

More precisely, let x be a character of h = Lie{H). Since the map p in (5.4.1) is 
finite, we have an identification h = ho © C. The character x is thus a pair {xo, 't), where 
Xo is a character of h and r G C. Let x'^°, x G Hq, be the multivalued group character 
corresponding to Xo^ similarly to (5.3.1). 

For / e Ma we denote by [// the open set {/ 7^ 0} C H. Let J\f^ be the 1-dimensional 
local system on Uf spanned by all the branches of the multivalued function x^°f{xy. Let 
Nq = dim(iyo)- Consider the constructible sheaf S = £{x) on Ma defined by its stalks as 
follows: 

(5.4.2) Sf^Hr,,{Uf,M^). 
We have the morphism of sheaves on Ma 

(5.4.3) J:S^Oma, Co = ^(7.., 0.) ^ J] / M^)dx. 

Images of sections of £ under this map will be called Euler integrals. 

(5.4.4) Proposition. Every Euler integral satisGes the A-hypergeometric system. 

The proof is straightforward. 

(5.4.5) Remark. It is more suggestive to write an Euler integral in the more classical 
form: 

(5.4.6) J(/) = / x''°f{xydx, 
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where Co C Hq is "an appropriate contour of integration" . On the heuristic level, the Euler 
integral over C Hq is obtained from a Fourier integral over the cycle C = Co x (^1^+) i^i 
i^o X C* by integrating away the R+-variable: 

/'g^A/(x)^r^ao^^^^^ f ff g-^^^^U^dA ) x'^" = r(T + 1) / f {x)'^-^ x''° dx. 

h ho / "'Co 

On the other hand, the first integral is equal to 

/ exp{if{x))x'^dx, 

JpiOcH 

where / e Ma corresponds to / e under the canonical identification. 

(5.5) Nonresonance. As in (2.4), choose a maximal torus T G H, let A be its lattice of 
characters and Ar, = A (8) R. We assume other notations of (2.4) as well. Let Ca C Ar 
be the convex cone with apex and base Qa- Thus nonempty faces of Ca are in bijection 
with faces of Qa- 

Let A° C A be the lattice of characters of the full group H, and Aq = A^ (g) C. Thus 
the character x defining the A-hypergeometric system, lies in Aq. For a face F C Ca we 
denote Linc(F) C Ac its C-linear span. We will say that x ^ -^c nonresonant, if for 
any face F C Ca of codimension 1 we have x ^ A + Linc(F). 

Note that unlike the toric case [16], it may be no longer the case that a generic x ^ 
is nonresonant. This will be true, however, if the set A is chosen generic enough (so that 
A° does not lie in any Linc(r),r C Ca)- 

The meaning of the nonresonance property is as follows. 

(5.5.1) Proposition. If x is nonresonant, then the natural morphism j\C^ — > Rj*C^ is 
an isomorphism in the derived category of sheaves on M^. 

Proof: The closure of H in is Ya, and H x i/-orbits Y{r) on Ya are in bijection with 
nonempty faces F C Ca- We have to prove the following statement: for each proper face 
F, each point y e Y{T) and small neighborhood U of j/ in Ya we have H^{U fl H, C^) = 
for all i. 

Consider first the case codim(F) = 1. In this case codim(y(F)) = 1, since the open 
orbit H C Ya is affine. Applying the slice theorem ([3], n. 1.5) to the normalization of 
Ya, we find that for y, U as above, U Cl H is homotopy equivalent to the disjoint union of 
several copies of the circle S^. The condition x ^ A + Linc(F) means that the monodromy 
of jC^ on each of these circles is nontrivial, so all the cohomology vanishes. 

The case codim(F) > 1 follows from this, since for such F and U, y as above, U (IH is 
fibered into unions of circles corresponding to any F' D F, codim(F') = 1. 

It seems that for Cohen-Macaulay Ya, the nonresonance condition should be sufficient 
to ensure that the systems of Euler and Fourier integrals are complete, i.e., the maps 
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X : T ^ Ti. and J : £ ^ Ti. are isomorphisms of sheaves. A possible approach to 
this (generahzing that of [16]) would be to find the characteristic cycle of the perverse 
sheaf This is a purely topological problem. For example, the multiplicity of TqM\ 

in the characteristic cycle is just the topological Euler characteristic of the hypersurfacc 
{f — e] <Z H for generic / e M^i, e G C. When is a torus, this Euler characteristic is 
equal to deg(X^), as follows from [34]. It is likely that a similar answer is possible for an 
arbitrary reductive H. 

(5.6) Matrix F-series. Another approach to solving the hypergeometric system is to 
expand the holomorphic distribution (5.3.7) into a formal power series and perform the 
termwise Fourier transform, using the formulas of (4.4). Since we will work with power 
series on G = Ila-eA ^-^(K;), let us introduce some notation. 

An element of G will be written as a = {aj). Let J^^ ~ (C*)'^^'*') be a maximal torus 
in GL{V^), and ~ 'Z^iuj) -^g lattice of characters. An element of will be written 
as a{u)) — (Q:(a;)i, a(u;)d(^)). Let us abbreviate Irr;^ := Irr(GL("\4>)) and identify this 
set with the set of dominant weights in S^^. A representation of G will be written as 

= E"*^'^)(T4)). Let Irr^^ be the set of positive dominant weights, i.e., those with 

all a(a))i > 0. 

Set J = YiujeA^^^ = ri'^tj, Irr = Hl^^u;- Let also S° = Z"^ C S be the lattice 
of characters of G. An element of S° will be written as s = {s^} and the corresponding 
character is a i— > Y{dei{a^Y'^ . 

We denote by Sr = S (g) R etc. Let also Irr^ be the convex hull of Irr^ in r,. 

Denote by 1^^ the set of aiuj) = (a(a;)i, Q;(<^)d(a;)) G C'^'-'*'-' with a{uj)i — a{uj)i^i E 
Z_|_ and then set I = Hcje^-'-'^' R-^call that the hypergeometric system depends on a 
character x of h. Let dpi_j be the representation of h corresponding to the representation 
of H. The set I, on the other hand, parametrizes irreducible representations of g = Lie(G). 
We introduce the space 

(5.6.1) L^=\s= (su,) e = ^-^^ "^P^ = 

In terms of the multivalued function this condition is expressed just as J| = x^. 

For any s E the formal series 

(5.6.2) Yl ^(«) • {UH),a^+'), a«+^ = (^X^^^ ' Kl'"" ^ 

Q:6lrr 

represents the distribution (5.3.7) on the compact form Gc C G. However, each term of this 
series also gives a distribution on the space M^®"^™ = Huje^ Herm(14;), where Herm(14;) C 
End(V^) = is the space of Hermitian operators, see (4.4). The corresponding series of 
distributions on M^'^™ does not converge but we still can form its term-by-term Fourier 
transform, using (4.4.6): 
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We get in this way a formal series called the matrix F-series. It has the following 
meaning, let U G G be an open simply connected domain, a* a branch of the function 
Yi det(at^)'^" in U, and Aig the 1-dimensional space of functions in U spanned by a^. Then 
$s(a) G C[[G']] (X>c -Ms, where C[[G']] is the space of formal series on G defined in (3.3). 
The action of differential operators on elements of C[[G]] ® M.s is defined similarly to 
Proposition 3.3.1. 

(5.6.4) Proposition, (a) If s' E LqCi Z^, then $s_|_s'(a) = $s(fl) as formal series. 

(b) The series $s(a) satisfies the A-hypergeometric system in the sense described above. 

Proof: Part (a) is obvious, part (b) follows from the properties of divided powers (Propo- 
sition 4.5.2). 

(5.7) Convexity and convergence of matrix P-series. Let (G, H) C Sr be the 

convex hull of all the weights of all those representations V[a] = ^Ti^'^^^Vcj) of G for 
which ^0. This is a convex but not necessarily strictly convex, cone in Sr. For a 
subset B C A we denote ps Sr — Hc^es '^t^,R- coordinate projection. 

(5.7.1) Definition. A subset B c A is called a cobase, if 



is a strictly convex cone. 

(5.7.2) Example. Let if be a torus, so that Irr(i/) = A is a lattice. A subset S C A is 
a cobase if and only if the complement A — S is an affinely independent subset, i.e., forms 
the set of vertices of a simplex, see [15]. 

(5.7.3) Theorem. If B is a cobase and s G is such that G Z for uj E B, then the 
series $s(a) converges in some open domain in G. 

If s satisfies the conditions of the theorem, we shall say that $s(a) is adapted to B. 

Proof: Because of the poles of the gamma-functions entering the factors Fd(t^) {a{Lv)+Si^ + l) 
in the denominators, we find that $s(a) is the product of a scalar monomial and a series 
$g(a) whose support lies in the cone described in Definition 5.7.1, which is, by assumption, 
strictly convex. Denote by S the set of all irreducible representations y of G such that all 
the weights of V lie in this cone. Then $'(a) belongs to the ring MffS']] of formal power 
series from (3.3) and satisfies a holonomic system with regular singularities. Thus it has a 
nonempty domain of convergence, by Theorem 3.3.2. 

(5.8) Terminating series. The set B = A is always a cobase. Unlike the torus case, it 
is not possible to guarantee the existence of any other cobases for general {H, A) (see §6 
for examples where nontrivial cobases exist). For B = A the condition of Theorem 5.7.2 
is simply that all the s^j are integers. A matrix F-series with this property will be called 
totally resonant. 
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Let us identify TA with Hom(G, C*), associating to s = is^) the character \b 



s 



s. 



Let 



(5.8.1) 



A AO = Hom(iy, C*) S Hom(C*, C*) = Z 



be the restriction maps. We think of A° as a lattice (inside Irr(if)) and for an element a of 
this lattice denote by x"' the corresponding character of H. Thus, the following is obvious. 

(5.8.2) Proposition, (a) If x is a character of h and s & L^D Z^, a — r{s), then x" is 
the same as the function defined by (5.3.1 ). 

(b) For s eZ"^ we have q{r(s)) = d{u;) ■ s^^. 

Now, our first remark about totally resonant series is; 

(5.8.3) Proposition, (a) Every totally resonant T-series is terminating, i.e., it contains 
only finitely many nonzero terms and is therefore a polynomial on G in the sense of (1.1). 
(b) This polynomial is, moreover, identically zero unless q{r{s)) < 0. 

For the torus case, terminating F-series were studied in [42] . 

Proof: Every representation : H ^ GL(V^) is homogeneous of degree 1 with respect 
to C* C H. Thus, in order that R[^] = (g) E"('^)(K;) satisfy ^ 0, it is necessary that 
^ |ci;(c<;)| = 0. Let s e Z^. Then \a{u!) + s^^l — \a{uj) \ + d{u!)s^. Notice also that the 
denominator in the coefficients of the series has a pole unless a{u}) + > for all 

LO. So our statement follows from the next obvious fact. 

(5.8.4) Lemma. The set of a = {a{Lu))u}£A such that all a{(jj) > and ^ |Q;(a;)| = d, is 
finite for all d and empty for d < 0. 

Let now {Ho,Ao) be an inhomogeneous pair, and {H,A) be its homogeneization, so 
that we have a surjective homomorphism p : Hq x C* ^ H with finite kernel. Let s e Z"^ 
and a = r(s) e A° be as before. Let 



be the puUback of a via, p. Clearly, r = — g(r(s)) > if $s does not vanish identically. 
(5.8.5) Proposition. The terminating series (a) is equal to the following Euler integral 



((Jo, -r) e Hom(ifo, C*) x Hom(C*, C*) = Hom(ifo, C*) x Z 



of/(x) = E, 



{a^,x^): 




where Hq c C Hq is a maximal compact subgroup. 



Of course, this integral can be calculated purely algebraically, since r e Z+. 
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Proof: We repeat the arguments of Remark 5.4.5 with = -f^o,c but with R+ replaced by 
the unit circle Ui. Accordingly, p{Q is replaced by the compact form Hf,: 

= t\ [ e^f^''^X-^x''°d*xd*X = t\D - f ef^^^x''d*x, 

where D is the degree of the map p, and / G Ma corresponds to / e under the 

canonical identification. On the other hand, 

f ef^^^x''d*x = I eK^\y^ir{a^hS)^H{hydh. 

Expanding now 5h into a series of distributions on Gc-, as in (3.4.2), we see that this time 
it is legitimate to integrate it tcrmwise, since the integration is taken over The proof 
is finished by applying the formula (4.7.2) to each factor of Gc = YiujeA Ud{uj)- 

(5.9) Deformation of vanishing F-series. Let s e be such that r = — X] d{(jj)Si^ < 
0. Then $s(a) vanishes identically. On the Euler integral side, however, the corresponding 
A-hypergeometric system is satisfied by functions J{f) — J f{xYx^°d*x, which are periods 
of rational differential forms on the spherical variety Xa, or on the hypersurface {/ = 0} C 
Xa- a way to obtain solutions from the general power series construction is by taking 
iterated derivatives of the $s(o) in s. For the toric case this method was used by J. 
Stienstra [46] (see also [26]) to construct all the solutions in the resonant situation. Here 
we will consider the simplest deformation s i— > (s^; +t), t E C. 

The function 1/F(2;) has a first order zero at z = —d, d = 1, 2, ... with the derivative 
{—lYdl. Thus, using the definition of the matrix F- function as a product, we find 



(5.9.1) 



di 



^{su.+t) (o) = ^^^^^ 



t=0 y^A 



(5.9.1') ^i''Ha)= Yl {d{a)Ci'^\a)UH), a-+-'), 

Q! e Irr : 
a{uj) + > 0, a; 7^ 7, 
Q;(7)d(^)_i + Sj + 2>0 



where Cs'^\a) is the following number: 
(5.9.1") 

^W(^) ^ (-l)--(^)'^(^)-^-^F(-a(7)rf(^)-.^) 

(n./7 r,(,) («('^) + «^ + 1)) n -2"' r(a(7), +s, + d{^) -3 + 1) 
(I am grateful to the referee for correcting this formula.) As before, we prove: 
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(5.9.2) Proposition. Each ^'p^ formally satisfies the A-hypergeometric system. 

We now consider one particular case, generalizing an observation of Batyrev ([1], 
Proposition 14.6). Namely, let {Hq,Aq) be an inhomogeneous pair such that e and, 
moreover, is a vertex of Qaq ■ Thus any / e is written as 

fix) = ao+ J2 ^"')' ^0 = ^0 - {0}. 

Let Irr^ = Ila^eA' Ii'r+(GL(Ft^)). For a e Irr^ let a e Irr have the following components: 
a{0) = — X^t^g^' d{Lij) • |Q!(a;)|, while d{(jj) = a{(jj) for cj e A'q. Let {H,A) be the homo- 
geneization of {Hq, Aq) with the standard bijection co ^ u), Aq ^ A. Let A' C A he the 
image of A'q. Taking Sq = 1 and = for a; e A', we get s e Z"^ such that $s(a) vanishes 
identically, while 



(5.9.3) ^f(a)= Yl n r A ^ n 

a^r; V na,eA^.rdM(a(a') + l) 



(5.9.4) Proposition. There is a domain U C Ma such that for f E U the hypersurfacc 
{/ — 0} does not meet the subgroup i/o,c C i^o, the series $i°''(a) converges in U, and its 
sum is equal to the following Euler integral 

$f (a) = const • / / = E («-^")- 

Proof: This is achieved, similarly to [1], by expanding 

ao 1 



into the geometric series. Terms of this geometric series are labelled by integer vectors 
m = (m^,) e {Z+)^o^ the term corresponding to m being 



(_!)!:"..( 2 m„ ! , 
(5.9.5) _A_^n(^t,(„„,./„„)j 



When ao dominates all the other a^^, the geometric series converges on a domain containing 
Hq^c and we can integrate it termwise. By applying the formulas (4.6.2-4) to each factor 
in (5.9.5) and using the orthogonality relations (3.0.1), we get the identification of the 
integrated series with ^^^\a). 
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§6. Examples. 



(6.1) A generalization of the Gauss function. We take the group Hq = C* x GLn = 
GL{L) X GL{V), dim(L) = 1, dim(y) = n. Take Aq = {C, L, V,L0V}. The pah (i/o,^o) 
is inhomogeneous (2.1.4). A natural homogeneization of {Hq,Aq) is: 
(6.1.1) 

iy = C* X C* X GLn = GL{N) x GL{L) x GL{V), A = {iV®^ N L,N (^V,L(^V], 

where dim(A'^) = 1. Thus 
(6.1.2) 

Ma = C©C©Matn(C)©Mat„(C) = End(iV®2)©End(iV(g)L)©End(iV(g)"l/)©End(L(8)"l/). 

A typical point in Ma will be denoted by (a, b, C, D) where a, 6 e C and C,D e Mat„(C). 
A point in the dual space will be denoted by (u, v, x, y) where tt, v e C and x,y & 
Matn(C). The variety Ya C from (2.2) is: 

(6.1.3) Ya = {{u, V, X, y) : uy = vx}, 

and Xa is the projectivization of this variety. Thus 

dim(XA) = + 1, deg{XA) = 2"'. 

The lattice of weights of ii" is A = Z © Z © Z", with the Weyl group W = Sn acting by per- 
mutations on the last summand only. We denote the basis vectors of A by e_i, cq, ci, e„, 
with e_i and eo spanning the first two summands. The polytope Qa is the cylinder over 
a simplex: 



(6.1.4) 



Qa = Conv|2e_i, e_i + cq, e_i + e^, cq + e^, i = 1, n| ~ x A"^. 



The ^-hypergeometric system is a system on a function $ = $(/) = ^[a,h,C,D) on 
Ma- Writing the quasihomogeneity conditions in the integrated from, we can represent 
the system as follows: 



da dDij db dCij 



(6.1.5) 



$(A2a, A6, AC, D) = A>^i$(a, 6, C, D) 
$(a, A6, C, \D) = A>^2$(a, 6, C, D) 

$(a, 6, t/C, t/i:») = $(a, 6, CC/, i:»t/) = |t/|>^3$(a, 6, C, i:»). 



Here x^, i = 1, 2, 3, are complex parameters labelling a character xofh = C©C© gl^- If 
$ is a solution, then by setting (/>(-D) = $(1, 1, 1, -D) we have: 

(6.1.6) $(a,6,C,D) = a^-^-'^6^2|C|>^30(^5-iC-i^)_ 
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(6.1.7) 



cl>{UDU-') = cl>{U), 







-1 


1^1+82 


|C| 


S3 


\D\ 


\'^d{v)s,{CD-^) 




+ si + i)r(-| 


\^\ 


+ S2 + l)r„(z/- + S3 + l)rn(j^ + S4 + 1) 



so, in particular, <f) is conjugacy invariant. The Euler integral solutions are: 

(6.1.7) ^{a,b,C,D)^ [ {a + bu + {C,y) + u{D,y)Yt'^ det{yydudy, 

where 

(6.1.8) ^ (^^^'^^^ ^) ' ^ = ^2-1, r = X3-n. 

(6.1.9) Proposition. The matrix F-series corresponding to s — (si, S4) has the form 

i/eIrr(GL„) 

Proof: The set Irr := Irr(G) consists of a = (mi, m2, /U, i^) where G Z and G 
Irr(GL^). The representation of G corresponding to such a a, has the form 

= (iv®2)®mi ^ ^ ^)®m2 (g, E'^(Ar ® F) ® S^(L (8) F) = 

^ ^®(2mi+m2 + |Ml) ^OCma + li'l) ^g, 5]''(V) (g) T,''{V). 

(6.1.10) Proposition, (a) The space possesses nonzero H -invariants if and only if 
IX = v~ , 1712 = —{^IjIt^i = 1 2^ I- In this case the space of invariants is 1-dimensional. 

(b ) If the conditions of (a ) are satisfied, then for x = {a,b,C,D) e G the function {Ia{H),x) 
is equal to 

a[i') 

Proof: (a) is clear. To see (b), consider the following less cumbersome case to which 
everything is easily reduced. Let H' = GL{V),G' = GL{V) x GL{V), so that H' is 
the diagonal in G'. Let a = G Irr(G") and let I e R^ ^ E^(T/) O S^"(F) = 

E^(y) (g) (E'^(y))* be the canonical pairing which generates the 1-dimensional space of 
i^'-invariants. Let p be the projection onto this 1-dimensional space along other isotypical 
components, so that for x = (C, D) G Go we have {Icr{H'), x) = tr{p o x'^). This last trace 
can be just seen as the matrix element {l\x'^\l) with respect to any i/'-invariant scalar 
product on E^(y) ® E'^(y*) such that (/|/) = 1. 

(6.1.11) Lemma. In the above assumptions we have, for x = (C, D) G G': 

d{a) d[a) 

Proof: It is enough to consider the case v = (1): in the general case we just consider 
the space S^(F) as the new V and S'^(C) as the new C etc. Assuming that a = (1), 
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we find that the element I can be viewed as the identity matrix 1 e End(F) = V ®V*. 
The GL(V)-invariant scalar product on End(V) such that = 1 is given by {X\Y) = 

tr(Xy)/ dim(y). The operator Pu{C) ®'^oivV®V* corresponds, after the identification 
V (g) ~ End(y), to the left multiplication by C; the operator 1 ® pjy-{D) corresponds 
to the right multiplication by . Thus our matrix element is equal to 

^ -tr((ClD-i) • 1) = —l—tT{CD-^). 



dim(V) ' ' dim(V) 

This establishes the particular case v = (1) and the general case of the lemma follows from 
that. This implies, in its turn. Propositions 6.1.10 and 6.1.9. 

The set A possesses two one-element cobases (5.7.1), namely Bi = {L V} and 
B2 = {N <S) V}. The matrix F series adapted to Bi can be obtained by putting S3 = 0. 
The series 0si,s2,s4(^) = *si,s2,o,s4(l> 1> 1>-D) has the form 

0S1,S2,S4(-D) = 

(6 112) =\D\^- V dil^>,^{D) 

^ ' ' r(-|/x| + si + i)r(|/x| + s2 + i)r„(/x + i)r,(/x- + s4 + i)" 

It converges near D = 0. Introducing the standard Pochhammer symbol 

(6.1.13) (a)^ = Q^-t^ = a(a + l)...(a + m- 1), aeC,meZ+ 

i [a) 

and the generalized, or matrix, Pochhammer symbol (cf. [23]) 

(6.1.14) ^flia + n- j),, = ^-(^^ + + , a G C, /. G Irr+(GL„) 

in(^a, ...,a; 

we can write, by using (4.6.4): 

(f>si,s2,s4{D) = const • ID]^" ■ 2^i(-si, -S4, S2 + 1; -D), 

where 

(6.1.15) 2^1 («,/?, 7; 2;) = T%^~Tr^M'5M(^)' a; e Matn(C). 

This function is similar to but not identical with the James-Biedenharn-Louck matrix 
generalization of the Gauss function [24] [30] [36], which is 

(6.1.16) 2Fiia,P,r,x)= Yl m""" M> M^^^^)' a; e Mat,(C), ||x|| < 1. 
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(6.2) A generalization of the Pochhammer function. Set G = (C*)^^ x GL^ x GL^ 
and let 

(6.2.1) H = |(iti, ...,Up,vi, ...,Vp,x,y) e G ui...Up ■ y = vi...Vp ■ xj. 

Here x,y G GL^. Thus H ~ (C*)^^ x GL^. Let A be the set of the tautological rep- 
resentations of the factors of G considered as representations of H. Thus C = 
C'^p X Matn(C) X Mat^(C) is given by the same equation as in (6.2.1). A point of Ma will 
be denoted by (ai, a^, 6i, 6p, C, D). The subgroup Hq C H given by ui = 1 satisfies 
the inhomogeneity condition. The ^-hypergeometric system depends on 2p + 1 complex 
parameters xi, ...,X2p+i and consists of the equations 

-$ = — — — — $ 



dai...dapddij dbi...dbpdc^j 

together with the quasihomogeneity conditions involving the Xi which we leave to the 
reader. The Euler integral solutions have the form 

$(ai, ap, bi, bp, C, D) = 



I I «o + ^ aiUi + biVi + (C, y) H " (-D, y) 



X 



P P P P 

X J] n det(y)^2-+My J] d^i, J] d^;^, 

i—2 i=l i=2 1=1 

where ( is an appropriate 2p — 1 + n^-dimensional contour in Hq. Any of the two n- 
dimensional representations in A forms a cobase with one element. The corresponding 
convergent F-series are easily expressed through the function 

p+iJ^p{ai,...,ap+i,(3i,...,l3p;x) = > — --—w^s^{x). 

(6.3) A generalization of the Appell's functions via 3j-symbols. We consider the 
same groups Hq and H as in (6.1) but take a bigger set of representations of Hq, namely 

(6.3.1) Ao = {C,L,V,L0 V, L®^ ®V} C Itt(Ho) 
which entails for the homogeneization: 

(6.3.2) A = |iV®3^ iV®2 (g) L, iV®2 1/, AT ® L (g) 1/, L®2 v|. 
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The space Ma consists of (a, b, x, y, z) with a,b E C and x,y,z E Mat„(C). 

We will concentrate here on the form of matrix F-series. The group G is C* x C* x 
GLn X GLn X GLn- Irreducible representations of G are parametrized by tuples a = 
(m, r, A, n, v) with m, r e Z and A, e Irr(GL^). The corresponding representation is 

= jV®(3^+2"+2|A| + lMl) ^ ^®(r+|M|+2k|) ^ j^A^y^ ^g, ^fiy ^ y^V. 

The problem of finding if-invariants in K^j is thus identical with the Clebsch-Gordan prob- 
lem for the group GL^. When n = 1, the problem is trivial, and among the hypergeometric 
series one finds Appell's functions Gi, Hs, Hq, as explained in [15], §3.2. So we consider the 
case n = 2. In this case the elementary representation theory of SL2 implies the following. 

(6.3.3) Proposition, (a) The necessary and sufEcient conditions for non-vanishing of 
i?f are: 

(al) 3m + 2r + 2|A| + = r + + 2\i^\ = 0, 

(a2) |A + + ji^l = and tie nonnegative integers Ai — A2, A*i — A*2, J^i — 1^2 satisfy the 
triangle inequahties, i.e., each of them does not exceed the sum of the two others, 
(b) If the conditions of (a) are satisfied, then is one-dimensional. 

To actually write down the series, we need to fix a basis in T,^V, V = C"^ . We choose 
the Gelfand-Cetlin convention, so that the basis vectors are denoted by e^^^ with k an 
integer, Ai > /c > A2. In this basis, the matrix elements are the following functions of 
X = \\xij\\ e GL2 (see [48]. p. 116): 

hm^-)-\A y(^_A,)!(A,-H!,,,f;r-.A ^ )\ J J" " ' 

i,i>0 

We will use the hermitian scalar product in which the e^.^'* form an orthonormal basis. It 
has the property that the action of U2 C GL2 is unitary. If A, v satisfy the conditions of 
(6.3.3) (a2), then the normalized generator of the 1-dimensional GL(F)-invariant subspace 
in E^F ® E'^F ® S^F is 

i,j,k 

where the coefficients, called the 3j-symbols, are nonzero only for z + j + /c = 0. They are 
easily reduced to the Clebsch-Gordan coefficients for the group SU21 see [19] [37] [48] and 
are, explicitly, as follows ([37], §54): 

(X H v\ ^ / (A2 + ;»l+Z/l)!(Ai+//2 + Z^l)! ^^ 

\i 3 k) y (2Ai + 2/ii+2z/i + l)! ^ 
- f^2)Kf^i - j)\{k - V2)\{yi - k)\{Xi + + iy2)Ki - Ai)!(Ai - i)\x 
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^ ^ z\{Xi + 111 + U2- z)\{z -j-V2- Ai)!(j -z- H2)\{z + i + Xi + ii2 + vi)\{Xi-z- i)\ ' 
The matrix F-series corresponding to s = (si, S5) has the form: 

^s{a,h,x,y,z) = a'^¥^\x\'^\y\'^\z\'^ ■ J] ( d(A)d(//)(i(zy)(-)l^l+2|^l x 



A,M,i'eIrr(G-L2) 
|A| + |^| + |i.|=0 



X 



r(-|/i| - 2\v\ + si + i)r(|//| + 2\v\ + S2 + i)r2(/x + 53 + i)r2(j^ + 54 + i)r2(jv + 55 + 1) 



Any two 2-dimensional representations from A form a cobase. The three types of conver- 
gent r series adapted to these cobases, are natural GL2-generahzations of Appell's series 
Gi, Hz, Hq. 
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